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Abstract. Two models of loss networks, Introduced by Gibbens et al. [9] and 
by Antunes et al. [2], are known to exhibit a mean field limiting regime with 
several stable equilibria. 

These models are reexamined in the light of Freidlin and Wentzell's large 
deviation approach of randomly perturbed dynamical systems. Assuming that 
some of their results still hold under slightly relaxed conditions, the mctasta- 
bility property is derived for both systems. 

A Lyapunov function exhibited in [2] is next identified with the quasipoten- 
tial associated with a slightly modified, asymptotically reversible, Markovian 
perturbation of the same dynamical system. 

Another interpretation, in terms of entropy dissipation, of the Lyapunov 
function in [2] is finally given. The argument extends to another, similar but 
closed model. 



1. Introduction 

Metastability has given rise to a profuse literature in the Statistical Physics and 
Probability Theory areas during the last decades. It concerns a wide range of 
models, from the Curie- Weiss model to lattice gas and spin models and to diffu- 
sion processes. See [13] and [3] for an overview of the subject. Metastability can 
be roughly described as the phenomenon occuring when a physical system stays a 
very long time in some abnormal state before reaching its normal - under the pre- 
vailing conditions - equilibrium state. The normal situation is only restored after, 
under some random perturbation or some other external provision of energy, the 
system can get over some energy barrier. Mathematically, it is usually formalized 
through exponential growth of some exit times under some asymptotic, supposed 
to correspond to the physics of the system. 

While the potential theoretic approach, more recently developed (see [3]), pro- 
vides sharp estimations on crossover times for reversible dynamics, a lot is still due 
to the large deviation approach developed by Freidlin and Wentzell in [7] (see [13] 
for an outline of the application range). It has lead to some quite complete de- 
scriptions of the exit path from a metastable state, e.g. for the Ising model under 
Glauber dynamics at low temperature. Yet again, reversibility is often crucial, even 
in this context. 

Metastability is expected to occur for some specific models in communication 
networks, but a formal proof is still lacking. Namely, [9] and [2| analyze two loss 
systems with local interactions, that admit a mean field limit as the number of 
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nodes goes to infinity. The model in [9] is ruled by an alternative routing procedure 
for blocked calls, adapted from [11], while |2] analyzes a simple model for a loss 
network with mobile customers. In both papers, the limiting dynamics are shown 
to exhibit a phase with several stable equilibrium points. |9j provides estimations 
of certain exit times for a one dimensional diffusion approximation of the model, 
suggesting that metastability occurs. This should also be the case for the model 
in [2], as suggested by simulations. 

Yet, much less is known for these network models than for the classical exam- 
ples cited above. In particular, their Markovian dynamics are not reversible and 
computing the invariant distributions is out of reach. Such useful quantities as 
Hamiltonian, energy barrier etc... are thus not available. However, it is expected 
that as the number N of nodes grows, the invariant distribution should be approxi- 
mately given by ZJ^^ exp{—Nh) for some energy function h that would play the role 
of the Hamiltonian in the limit. In 2 a Lyapunov function for the limiting dynam- 
ical system is exhibited (and used for proving multistability), but this function has 
no reason to describe the correct energy landscape. In particular, it is not known 
which equilibrium points are asymptotically relevant in the invariant distribution 
(i.e., correspond to global minima of the possible Hamiltonian). 

The main purpose of the present paper is to show that the models in [3] and [2] 
essentially fit the scheme of Freidlin and Wentzell ([7 ), as - in these authors' ter- 
minology - locally infinitely divisible processes. This is the object of Section [3l As 
a result, exponential growth (as N gets large) of exit times from neighborhoods of 
stable equilibrium points, that is, metastability is obtained. The location of the 
exit points can also be described. 

It must be pointed out that the large deviations results stated in [7] are not 
rigorously applicable to the processes of interest in this paper, since these evolve in 
some compact subset of R'', on the frontier of which some of the technical hypothesis 
required in [7] are no longer valid. Yet, it seems that there is no fundamental reason 
for these restrictions. Extension of the results in [7] to this slightly more general 
context will thus be used without proof. Such a proof is beyond the scope of this 
paper, that aims at opening a way for understanding the stochastic behavior of 
systems for which only the deterministic limiting evolution has been described so 
far. 

A second issue of this paper is to decrypt the Lyapunov function exhibited in [5] . 
Two answers are given in this direction. One, presented in Section |31 is related 
to the quasipotential introduced in [7], which is the crucial quantity involved in 
estimations of exit times and exit points. Moreover, as suggested in [7] from the 
thoroughly analyzed case of diffusion processes, when there is just one equilibrium 
point, the quasipotential should represent the underlying energy function associated 
with the stationary state. It is here proved that the Lyapunov function exhibited 
in [2] coincides with the quasipotential of a slightly modified version of the process 
of interest. In addition, a heuristic argument suggests that the modified process is 
asymptotically reversible as the number of nodes gets large. 

Section |4] is devoted to another interpretation of this Lyapunov function, related 
to the well known decrease of relative entropy along a semi-group. This relies on 
a very particular feature of the model in [2]. Yet, two other models (particular 
in some other sense) can then be introduced, to which this principle for obtaining 
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a Lyapunov function can be exported. This helps proving convergence of their 
invariant distribution to a Dirac mass. 

Section [5] recalls the two models of interest and main results from fH' and [5] . 

2. Mean field limits, multistability 

This section gives a short review of the models in j9] and [2] and of the main 
results therein. These models exhibit a mean field limiting dynamics of some generic 
form, of which two other examples will be given in Section |4l But only the two 
models from [9 and 2 exhibit a phase with several stable points. 

2.1. Multistability due to rerouting. A first example of bistability in queue- 
ing networks is given in [9]. The analysis is formalized through convergence of 
some family of empirical processes to some dynamical system. All the subsequent 
examples of this section and Section 2] will fit this frame. 

This first model is a simplified version of a network with alternative routing 
proposed in [11]. In [1], a lattice version, with long range rerouting, is proposed. 

The model in [9] is the following: The network considered consists of N nodes 
offering the same finite (integer) capacity C > 1. Customers enter the network at 
the different nodes according to N independent Poisson processes with intensity 
A > 0. When some customer arrives at some node where no more than C — 
1 customers are present, he occupies one unit of capacity for an exponentially 
distributed service time with mean one. When some customer arrives at some 
saturated node, he is rerouted to two other nodes, chosen uniformly among the 

— 1 possible nodes. If both chosen nodes have one unit of capacity available, 
the customer then behaves like two independent customers, leaving the nodes after 
two independent exponential times with mean one. In the contrary (i.e., if at least 
one of the two nodes is saturated), the customer is definitively rejected from the 
system. 

Due to symmetry with respect to the A^ nodes, the quantity of interest is the 
empirical distribution of the nodes as function of time, that is 

1 " 

(1) ^""w^^^EVw 

1=1 

where (t) denotes the number of customers present at node i at time t and Sx 
is the Dirac mass at x. 

The Af (i) {N > I, t > and i ^ l,...,N) evolve in the set A" = {0, ... , C}. 
Identifying the set ViX) of probability measures on X with the set 

y=\y^ (yo, ■ . ■ ,2/c) e [0, J] - i| ' 

I n=0 J 

where j/„ represents the mass at n (n = 0, . . . , C) of the probability measure y, one 
can write Y^{t) = (y,f (0,0 <n<C), with 

1 ^ 

(2) Yn{t)^j;jY.^{X['(t)=n}- 

i=l 

In other words, YJ^ (t) is the proportion of nodes that are in state n at time t. 
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For any fixed > 3, (y^(<), t > 0) is a Markov jump process with the following 
transitions and rates, where e„ denotes the n*'* unit vector in R'-^+^: 



y + -w{(^n+i - e„) 
y + -^(en-i - e„) 

. y + :^(e«+i - e„) 



Nnyn 



at rates 



O \ J±JJCjMJrn_ 

^^(Ar-i)(Ar-2) 



(0 < n < C- 1) 
(0 < n < C) 

(0 < TO ^ 71 < C 



^ iN-l)(N~^2) lU < ri S O - ij 



The first jump corresponds to some arrival at some node with n customers, the 
second one to some departure from some node with n customers and the two last 
jumps correspond to rerouting of some customer to two nodes with, respectively, 
different or equal numbers of customers. 



[9] proves that for any T > 0, the process (F^(t),0 < t < T) converges in 
distribution, as N goes to infinity, to the solution with initial value y(0) of the 
following differential system of equations; for n = 0, . . . , C 

y'nit) = a(i + 2yc{t){l - yc{t))yn-i{t)tn>i + (n + l)zj„+i(t)l„<c-i 

- (a(1 + 2yc{t){l - yc{t)) + n)yn{t). 

provided that {0) converges in distribution to y(0). 

The vector field characterizing the limiting dynamical system, given by the right 
hand sides of this differential system, can be heuristically obtained by computing the 
infinitesimal mean jump from position y (suming up the jump amplitudes multiplied 
by the corresponding rates) and letting N grow to infinity. 

Introducing the family of infinitesimal generators [Ly, y ^y) defined by 

Ly/(7i) = \{l+2yc{l-ycm{n+l)-f{n))%,<c-i+n{f{n-l)-f{n)) (/ G R^, 7i € 
the above differential system rewrites as one unique differential equation on y: 
(3) y = yLy, 

where the second member is the product of probability measure (or row vector) y 
by the infinitesimal generator (or rate matrix) Ly. For y Cz y, Ly is the generator 
of an M/M/C/C queue with arrival rate A(l + 2yc{l — yc j) and service rate 1. 

Equation ([3]) precisely conveys the mean field property of the model: it tells that, 
in the limit N oo, the empirical distribution y{t) of the nodes evolves in time 
as the distribution of some non- homogeneous Markov process on X = {0, . . . , C}, 
whose jump rates at time t are given by ij,(t), being hence constantly updated 
according to the current distribution, or "mean field" y{t). These jump rates are 
those of an M/M/C/C queue. Only the arrival rate is time dependent, and more 
precisely depends on ycit), that is, on the proportion of saturated nodes. This 
M/M/C/C queue can be viewed as representing the instantaneous evolution of a 
"typical node" under the global influence of the other nodes. Due to symmetry, for 
large A^, this virtual node summarizes the whole network. 
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All the forecoming examples (Sections [2] and |4]) will follow this scheme, with 
different types of dependency on y of the mean field arrival rate. 

The equilibrium points of the limiting dynamical system ([3]) are the solutions of 
yLy — 0. Since for all y, Ly is the generator of some ergodic Markov process on X, 
this means that y is equal to the unique invariant distribution associated to Ly. 

The M/M/C/C queue with arrival rate p and service rate 1 is known to be re- 
versible, having invariant distribution given by the well known Erlang distribution: 

(4) ^.^(„)^_L-^ (n = 0,...,C), 

where Z{p) = X)n=o l"^^- is a normalizing constant. Equilibrium points are thus 
given by the solutions of the fixed point equation 

(5) y^Vp^y), 

where p{y) = A(l + 2yc(l - yc))- 

[9] shows numerically that for certain values of A, this equation exhibits several 
solutions, namely three, among which two are stable and one is unstable. This 
suggests that for N large and for suitable values of A, the system should be attracted 
to one of two possible states, both of the Erlang form but with two different values 
of p. Intuitively, the system can either fall into a heavy loaded regime or into 
a light loaded one. In the first one, the heavy load maintains itself by inducing 
many reroutings, while in the opposite way, a small proportion of saturated nodes 
maintains a low rate of rerouting. 

Remark 2.1. A slight variant of this model consists in rerouting customers to 
only one other node, but instead, changing their service rate from 1 to some value 
p < 1. One can prove that multistability still occurs for well chosen values of p and 
A. Notice that, in order to preserve the Markov property, it is here necessary to 
introduce two types of customers: those with service rate 1 and the rerouted ones, 
with service rate p. 

2.2. Multistability due to coexistence. A second example of multistability in 
the networks context is given by ^ . One major difference with the previous model 
is that here multistability can occur only when different classes of customers coexist 
having different capacity requirements. Besides that, the model deals with mobile 
customers travelling from one node to another (and being possibly rejected during 
their service). 

Here again, the network consists of N nodes with capacity C, now offered to K 
different classes of customers. For = 1, . . . , if, each customer of class k occupies 
Ak units of capacity at each node he visits (1 < At < C). Class k customers 
arrive at each node according to some Poisson process with intensity Afc , and have 
service times exponentially distributed with parameter pk- When some class k 
customer arrives at some node where his capacity requirement is not available, he 
is definitively rejected from the network. Otherwise, he begins to be served at 
this node, and then moves at rate 7^- during service. At each move, a new node 
is chosen uniformly among the N — \ possible nodes. Customers either leave the 
system through rejection at some node along their route, or through end of service. 

All arrival processes, service durations and sojourn times of customers at the 
different nodes are assumed independent. 
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The empirical distribution Y^{t) of the nodes at time t is stiU given by equa- 
tion ([1]), but here the state {t) of node i at time t is if-dimensional, consisting 
of the different numbers of customers of each class present at node i at time t. The 
state spaces X of variables {t), 1 < i < N,t > 0, and y of Y^{t), t > 0, are now 

K 

X ^{ne IN^^' ; UkAk < C} 

k=l 

and y = r{X) = ly = {yn,n E X) e ^ y„ = 1 I . 

I nex J 

Here again = {Y^{t),n e X) for t > 0, where Y^it) is given by equation Q. 

Note that the process Y^ actually evolves in some finite subset of 3^: 

y"" = {y = {yn,n ex)ey: Ny,, e IN for n e X}. 

Y^ is a Markov jump process with the following transitions, where fk denotes 
the fc*'' unit vector in [k — 1,...,K) and e„ is the n*'' unit vector in E,'*' 
(n e X): ioT I < k < K , n,m e X , 

y + 7ri(^n+fk - en) XkNyntn+f^eX 
y — > < y + -^(e,i-/fc - e„) at rates ^ikNnkyn 

. y + :^((e™+/fc -em)lm+/fceA' + e„_/, -e„) ikNukV^ ^j^^^ _ 

The first jump corresponds to the arrival of some class k customer at some node in 
state n, the second one to the end of service of some class k customer at some node 
in state n, and the last one to a move of some class k customer from some node in 
state n to some node in state m (possibly saturated, implying rejection). 

It is proved in [5] that for T > 0, the process {Y^{t),0 < t < T) converges in 
distribution to {y{t),0 < t < T) solving the differential system of equations in 3^: 

K 

y'nit) = [{^k +-fk[Ik,y{t)]jyn-f^it)ln^>l + {^ik + 7k){nk + l)yn+fJt)ln+f^eX 

k=l 

-{i^k + Jk[lk,y{t)])ln+fkex + ifJ-k +7k)nk^ynit) [n G X), 

if Y^{0) converges in distribution to 2/(0). 

Here [Ik,y] — nkyn is the mean of the fc*'' marginal of y (in particular 

nGX 

[Ik,Y^ (t)] is the number of class k customers per node at time t in the network, 
that is, the density of class k customers present). Convergence in distribution refers 
to the Skorohod topology on V{[0,T]). 

This system can here again be written as ([3]) where Ly is now the infinitesimal 
generator of an M/M/C/C queue with K classes of customers having different 
arrival rates + 7^ [Ik , y] , service rates ^k + Ik and capacity requirements Ak 
{k = l,...,K). 

Note that in [S] a similar mean field limiting dynamics, described by a non linear 
equation in the form of ([3]), is obtained for a system of interacting queues. The 
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Ly involved are birth and death generators with parameters depending on the mean 
of y, as in our present case. However, a major difference with the present model 
is that the stochastic dynamics itself involves a mean field interaction: The arrival 
rates of customers in the network depend on the global density of occupation. On 
the contrary, in the model from [2 , interaction between customers is local (only 
due to saturation at some node) and the mean field evolution only appears in the 
limit. 



Erlang formula ^ for the invariant distribution of the M/M/C/C queue extends 
to the case of K classes of customers with capacity requirements Ak and arrival 
rate-to-service rate ratios pk (fc = 1, . . . , K), where nl and p" {n e X) now hold for 



K K 



n\ = Y{nk\ and p" - [| p^!-" [n = {m, . . . .uk) & X). 



k=l k=l 



Z(p) is here given by V ^. Equilibr ium points are then again charac- 

nl 

nex 

terized by ([5]), where p{y) is now multidimensional: p{y) = ( ^ ^^y^ \ 

V Mfc + Ik J i<k<K 

In [2], coexistence of several equilibrium points is proved to occur when K = 2, 
Ai — \ and A2 — C, for C sufficiently large and for certain values of parameters 
Afe, /Ik and "fk {k — 1,2). A key argument is the determination of a Lyapunov func- 
tion for dynamical system that is, some continuously differentiable, bounded 
from below, function g defined on [0, -t-oo['^ such that 

yLyVg{y)<0 {y e y C [0, 

where equality holds only if yLy = 0, i.e., if y is an equilibrium point of the 
dynamics. 

g is explicitely given by 



K 



(6) giy) = V y„log(n!y„) - V / log '^''^ ^''^ dx. 

Moreover, g satisfies: for y G y, 

yLy = ^ Vg{y) ± y, 

so that equilibrium points are characterized as the critical points of g\y. An analytic 
function argument shows that these critical points are isolated. 

These properties of g allow one to discriminate stable (local minima of g) from 
unstable (local maxima and saddle points of g) equilibrium points. 

Multistability is then proved (for certain values of the parameters) by proving 
existence of a saddle point for g, and then showing that two local minima are nec- 
essarily present, one on each side of some line crossing the saddle point. 

Besides the multistability issue, a Lyapunov function is a tool for showing that 
equilibrium points of the limiting dynamical system are the concentration points, 
as TV — >■ 00, of the invariant measures tt^ of processes Y'^ (note that Y'^ is an 
irreducible Markov jump process on the finite state space y'^ , so that it admits a 
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unique invariant measure denoted tt^). This means in some sense commutation of 
limits as iV -T- oo and t +00. 

More precisely, it is proved in [2] that the infinitesimal generator fi^ of 
converges to the generator of the limiting (degenerated) Markov process given 
by (l3|). 57 is defined, at any function / on K,'^, by 

nfiy)^yLyyfiy). 

It is then standard that any weak limit of the sequence (tt^) is an invariant measure 
for f2. The Lyapunov function then makes it possible to show that the invariant 
measures of fi, hence the weak limits of (tt^), are precisely the convex combinations 
of Dirac masses at equilibrium points of In particular, when the equilibrium 
point y is unique, tt^ converges to the Dirac mass at y. We refer to [Ij for details, 
or to the proof of Proposition 14.31 hereafter. 

3. Large deviations, quasipotential 

As just recalled, the Lyapunov function g associated with the model in [2] helps 
describing the weak limits of the stationary distributions tt^ of the corresponding 
processes . Such a function is not available in the case of [9]. Indeed, Sections [3] 
and [4] will emphasize the specificity of the model of [2^ that makes the explicit 
formulation of g possible. 

Note however that the previous analysis of the model in [2] does not tell which 
stable equilibria remain significant in the limit, in the multistable phase. It is not 
even proved that the weak limits of tt^ have positive mass only at stable equilib- 
rium points. 

In this respect, a more precise issue would be to find, for both models of interest, 
an energy function h describing their invariant distribution tt^ as — >■ cx) in the 
sense that 

„-Nh(y) 

iovyey'^. 

Such an h is expected to be a Lyapunov function for the limiting dynamical system, 
or at least to satisfy yLyVh{y) < (see Remark [3^ below) . 

This amounts to stating a Large Deviation Principe for measures tt^ (with ac- 
tion functional I{y) = h{y) — min^ h). Global minima of h would then provide the 
concentration points of in the limit (the global minimum should be unique, for 
most values of the parameters) . 

The forecoming analysis will not directly address this question. We will focus 
on another issue, which is not elucidated in [2]: Metastability. In [9] metastability 
is proved to hold for a rough one-dimensional diffusion approximation of the model 
considered. It tells that as N gets large, the process stays trapped for some long 
time, of exponential order in N , in the neighborhood of any stable equilibrium point 
(regardless of its asymptotic significance in the invariant distribution) . 

The present section will show that both models in P] and |9j exhibit a metastable 
behavior, as a consequence of the Large Deviations results of Freidlin and Wentzell 
(ref [7]), here supposed to be still valid under slightly enlarged conditions. 

A central notion in [7] is the quasipotential. For diffusion-like perturbations of 
dynamical systems, this quantity appears in [7] as the energy function mentioned 
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above, under suitable hypothesis, among which uniqueness of the equihbrium point. 
It is not clear that this holds for Markov jump processes as those considered here. 
Nevertheless, the quasipotential is involved in estimations of exit times that give 
evidence of metastability. 

Here, it will be moreover shown that the Lyapunov function exhibited in [2] is 
actually equal to the quasipotential of a slight variant of the model of W associated 
with the same dynamical system. 

The following very simple observation opens the way to using the Large Deviation 
results of Freidlin and Wentzell. The two models in 2 and [9], recalled in 12.11 
and l2.2| have a similar structure: For each N ^ they are described by some irreducible 
Markov processes {Y'^{t),t > 0) on the finite subset = {y & y '■ Nyn G 
IN for all n 6 X} oi y = V{X), with transitions y — > y + -f^, where z lives in 
some finite set Z C {{zn)nex G : X^n ~ '^l which is independent of y and 
N . Moreover the rate of jump from y to y -\- is given by 

(7) Q^{y,y+j^)^N[^,y{z) + 0{l/N)), 

where {fJ-y)yey is a family of positive measures on Z with index y in 3^ = V{X) 
such that 

• iJLy{z) is continuous with respect to y G 3^ for fixed z, 

• fJ'yiz) = whenever z„ < for some n E X such that ?/„ = 0, that is, if 
y G dy = {y E y : 3n, yn = 0} and if the jump (y, y + z) is directed toward 
the outside of y. 

In the above expression of jump rates, 0(1/ N) denotes functions of N, y and z, 
whose product by N is uniformly bounded in y E y. 

Jump rates ([7]) tell that in the neighborhood of some y, the process is approx- 
imately described by the random walk with jump rates fJ-y{z), z E Z, rescaled by 
accelerating time and shrinking space by the same factor N. 

For y E y, denote ruy the mean of measure fiy {fXy is not a probability measure 
in general): 

TOy = ^ z^J,y{z) {my e {{zn)nex e K,'^ : ^ 2;„ = 0}). 

Then for T < +oo, (l"^(i))o<i<T converges in distribution as N tends to infinity 
to the dynamical system: 

(8) y{t)^my(^t)- 

In both examples of interest, niy = yLy for some family {Ly) of reversible gen- 
erators. This will be essential for both interpretations of the Lyapunov function 
of [5] , respectively given in Theorem 13.11 and Proposition 14.11 

As mentioned in Section [5J the models in [S] and [5] exhibit three equilibrium 
points (among which two are stable) for suitable values of the parameters. 

If terms 0{1/N) in the jump rates ([7]) are omitted and y is replaced by E,'^, 
the resulting processes belong to a class introduced by Freidlin and Wentzell in [7] , 
Chapter 5, as locally infinitely divisible processes. Their context is more general. 
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since the infinitesimal generators they consider include both jump and diffusion 
terms, writing for functions /, 

f]^(/) = K,V/(2;))+iV / 

where, here and after, ( , ) denotes the usual scalar product in R'*. 

The main result in Chapter 5 of [7j is that these processes satisfy a Large De- 
viation Principle on any finite time interval [0,r], with scaling coefficient iV and 
action functional given by 

S (if) — { -^0 ^("^t' '^^ ^'-'^ absolutely continuous if s.t. the integral is well defined, 
[ -l-cxD otherwise 

where L{y, ■) is the Legendre transform of some H{y, •) given in our discrete pure 
jump case by: 

(9) i?(2/,a) = ^A*,(z)(e<"^^>-l) (aeR^). 

zez 

Recall that this Legendre transform is defined, for y G 3^ and /3 G R'', by 

L{y,l3)= sup [{a, (3) - H{y, a)]. 

Large Deviation estimates are then deduced for derived quantities as the exit 
point, exit path and exit time from some domain included in the attraction basin 
of a stable equilibrium point yo. The estimations for the exit point and exit time 
both involve the quasipotential V relative to yo, which is defined as: 

^(yo, y) = inf{5'oT(¥') -.T > 0,(p absolutely continuous , ipo = Vo, fr = v}- 

The exit point from some attracted domain D is shown to be concentrated around 
the point y, if unique, minimizing V{yo,y) on the boundary dD of D, while the 
logarithm of the exit time is close to N times the minimum value of V{yo,y) on 
dD. 

A Large Deviation Principle is stated for the invariant distribution, with action 
functional precisely given by V{yo, y), but only in the pure diffusion case and when 
the equilibrium point yo is unique. This cannot thus be applied to the multistable 
models of interest to us. 

The main large deviation result for sample paths (hence all its subsequent re- 
sults) relies on a set of technical hypothesis about the function H and its Legendre 
transform L. They can be summarized as follows: 

L finiteness of sup^ H{y, a); 

IL finiteness of L{y,/3); local in /3, uniform in y boundedness of L{y,[3) and 
V i3L{y, P); strict, uniform in y convexity of functions L{y, .); 

in. some specific equicontinuity property of functions L{-,f3). 

The last condition is essentially used for replacing arbitrary sample paths by 
polygons. The mere proof of lower semicontinuity of Sqt makes use of it. 

The models in [2] and [9] differ from the pure-jump processes of j7| both through 
the second order terms 0{1/N) appearing in the jump rates, and through the 
compact state space y standing in place of R'*. 



f{y + ^)-f{y)-^{z,vf{y)) 



dfiy{z) 



2iV 



' dyidy, ' 
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Dropping one component of y = {yn)nex iJ2n Vn = y can be identified witli 
a compact subset of R'* with d — \X\ — 1. Transitions can then be extended outside 
y to the entire space R''. But II and III then fail to be true, due to the fact that 
for y on the frontier of 3^, L{y,(3) = +00 for ah /3's outside some cone, depending 
on y (and not only consisting of those /3's pointing out of y). 15 slightly relax 
conditions I and II, but this is still not sufficient for our purpose. New arguments 
need thus be found to free from these conditions, in order to deal with sample paths 
hitting or starting on the boundary of y. Note that condition I is satisfied, due to 
compactness of y and continuity of each fJ.y{z) with respect to y. 

As for the second order terms 0{1/N), here again the proof of the Large Devi- 
ation principle for sample paths (with action functional Sqt) needs to be adapted. 
The same change of measure technique might be used, but with and its Le- 
gendre transform instead of H and L, where i/^ is defined analogously to 
H in (HD, replacing ^^(z) by fiy{z) + 0{1/N) = l/NQM{y,y + z/N). The terms 
0{1/N) should finally not infer on the estimations. 

All this constitutes a challenging problem which is not addressed in this paper. 
For the present discussion, it is admitted that all the above mentioned results from 
Chapter 5 of [7] (that is, the Large Deviation Principle for sample paths, from 
which all other results derive) still hold for the two models of interest in this paper. 

In all what follows, the state space y is identified with the compact subset of R'*, 
where d = \X\ — 1: {y & [0, -|-oo['': X)iLi Hi — 1}' dropping for example coordinate 

of y = {yn)nex G 3^- Similarly, the set Z of possible jumps is identified with 
a finite subset of R''. H{y, a) is then defined by ^ for y e y and a e R"*. This 
embedding of y in the correct dimension space R"^ in which the process lives ensures 
at least that the conditions I to III of [7] are satisfied in the interior of y. 

Let us just mention that the lower semicontinuity of Sqt can be proved in our 
context by describing Sqt as the supremum of functionals Sqj^ that satisfy the 
conditions in [7]. Indeed, extend the fJ,y{z) to all y E Mf^ so that, for all z E Z, 
y H- fJ'yiz) is continuous with compact support. Then introduce the following 
perturbations of the resulting H: For e > 0, 

H%y, a) = Hiy, a) + £ ^ (e<"'^> + e'^^'^^ - 2) , {y,ae R"), 
zez' 

where Z' is some finite subset of R'' whose generated convex cone is the whole 
space. It can then be proved that the H'^ and their Legendre transforms satisfy 
conditions I to III (following the lines in the last section of J3] for III). According 
to [7] (theorem 2.1 of Chapter 5) or [15], the associated Sqj, are then lower semi- 
continuous on the set of continuous paths in R"^ endowed with the uniform norm 
topology. 

Now H'^ clearly decreases to iJ as e decreases to 0, so that L'^ increases and 
L{y,P) = sup[{a,P) - H{y,a)] = supsup[(a, /?) - H''{y,a)] = supL=(y,^). 

a a e e 

It follows by monotone convergence that Sqt — sup^ S^j^, from which the lower 
semicontinuity of Sqt follows. 

Notice that semicontinuity of Sqt together with condition I imply (see |15j ) that 
the level sets of Sqt (that is, the sets {ip : Sorif) < s} for s G [0,-|-oo[) are com- 
pact sets in the topology of uniform convergence. This is technically important for 
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proving the Large Deviation Principle along the classical scheme. 

Metastability refers to the large deviation result for exit times from neighbor- 
hoods of stable equilibrium points. Theorem 4.3 of Chapter 4 of gives the main 
estimate of such exit times for Gaussian perturbations of dynamical systems. It is 
then indicated in Chapter 5 how to adapt the proof to a jump-like perturbation of 
the above described form. In both situations, the result is derived from the Large 
Deviation Principle for sample paths. 

Recall that an asymptotically stable equilibrium point is an equilibrium point ya 
such that for any neighborhood J\f oi yo, there exists some smaller neighborhood 
A/"' such that any trajectory initiated in A/"' converges to yo without leaving Af. 

Also, a domain D is said to be attracted to some equilibrium point yo if any 
trajectory initiated in D converges to yo without leaving D. 

For the model in 2 , the Lyapunov function g ensures that all stable equilibrium 
points (that is, local minima of g) are asymptotically stable. 

From the above discussion, one can deduce from Chapter 5 of the following: 

Corollary 3.1. Assume that the Large Deviation Principle for sample paths, with 
action functional Sqt, is valid for the model in [2 . Let y^ he any stable equilibrium 
point for the limiting dynamics, and let g he the Lyapunov function given by ([6]) . 
For any positive S, define Bg as the connected component of yo in the set {y G y : 
9{y) < 3(2/0) + 5}. Define 

rf - mi{t > : i Bs}. 

If S is small enough, then for any a > and y G Bg, 

hm P^(e^W'-") < rf < e^(^«+")) = 1 

where Vo = minj^/ggss yiVQiU')- 

Proof. In order to apply Theorem 4.3 of Chapter 4 of 0, in its modified version 
discussed in Chapter 5, it must be proved that yo is an asymptotically stable equi- 
librium point for the dynamical system y = ruy, that for small enough S, the domain 
Bg is attracted to yo and has smooth boundary dBs, and that {n{y),my) < for 
y G dBg, where n{y) is the exterior normal at y. 

As indicated in Section [51 the critical points of g are isolated, so that the stable 
equilibria, that is, the local minima of (7, are necessarily strict local minima. It is 
then classical (see for example |14j ) that, due to the Lyapunov property of 5, yo is 
asymptotically stable. 

Now choose some open ball B{yo,r) centered at yo, with radius r > small 
enough so that g{y) > g{yo) for ah y G {B{yo,r) U dB{yo, r)) \ {yo] {yo is a strict 
minimum of g) and that any trajectory initiated in B{yo,r) converges to yo iuo is 
asymptotically stable). Denote (5o = inf{g(y)— ^(yo) : y G dB{yo,r)}. Compactness 
oi dB{yo,r) implies that 5o > 0. 

For any 5 > 0, by the decreasing property of g, the set {y & y : g{y) < g{yo) + S} 
is invariant under the flow. The same is then true for the connected component 
Bg, by continuity of trajectories. In addition, for S < So, hy connectedness of Bg, 
Bg C B{yo,r) (if this were not the case, Bg would meet dB{yo,r), contradicting 
g{y) — .g(yo) < S on Bg). It then results that Bg is attracted to yo. 

It now only remains to prove, still assuming 6 < 6o, that dBg is smooth and 
that {n{y),my) < for y G dBg, where n(y) the exterior normal of dBg at y. Both 
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properties derive from the fact that dBs is a level surface for g. In particular, 
Wg{y) — ayn{y) for some non-negative ay, which is not zero since y is not an 
equibrium point (take 5 < Sq here). Then {n{y),ray) = {a~^'Vg{y),my) < from 
the Lyapunov property of g. 

The proof is achieved by applying the above cited theorem of in its version 
corresponding to the jump-process case of Chapter 5. 

□ 

Remark 3.1. For the model in the same kind of estimation holds for exit 
times from neighborhoods of asymptotically stable points. Note however that little 
is known for this model: Multistability is obtained numerically, and asymptotical 
stability of stable points remains to be proved. 

A companion corollary can be stated, telling that the exit point from a neighbor- 
hood Afoi j/o is, with high probability as N ^ oo, close to the point that minimizes 
V(jjo,y) on dAf, when this one is unique. However, this last condition is not guar- 
anteed for Bs- As an example, for the modified model introduced below, V(jjo, .) 
and g coincide up to a constant on some neighborhood of j/o fTheorem l3.ip . so that 
Bs is not a good choice in this case, V{yo, .) being constant on dBs- 

It will now be proved that g is equal to the quasipotential of a process obtained 
from the model in by modifying the jumps in Section 12.21 as follows: Moves of 
customers from one node to another are replaced by departures and arrivals now 
occuring independently. In other words, jumps of the form y — > y + jj{em+fk ^ 
em + e-n-fk - en) are now split into jumps y — > y + -^(e„i+/^ e„i) and y — > 
y -\- j^{en-fk — Gn), each keeping the original rate. This modifies the Markovian 
dynamics, but not the limiting dynamical system. 

The new transitions and rates are easily checked: For 1 < k < K, n X, 

( y+j.(^en+f,-en) A^((Afe+7fe[4,2/])y„l„+/,e^ + 0(l/iV)) 

y — > < at rates 

I y+w(^n-h-en) iv((/i,+7fe)nfc2/„ + 0(l/A^)) 

Formally, the initial Markov process on has jump rates as in ([7]) with 
niy = z^y{z) = yLy {y G 3^) where Ly is some infinitesimal generator (namely, 

that of an M/M/C/C queue with K classes of customers and for k = 1, . . . ,K, 
arrival rates + 7fc[//c, y], service rates fik +7fe and capacity requirements Ak). So 

m.y = ^ {ymLy{m,n) - ynLy{n,m))en = ^ yrnLy{m,n){en - Cm). 

(m,n)eAr2 (m,n)GAr2 

For the modified process just described, transitions are reduced to "elementary" 
jumps of the form y — ¥ y+jf{en~Sm), with the associated rates N{ymLy{m, n) + 
0{\/N)). In other words, for the new process, ([7]) is still satisfied with ^y{z) now 
defined for y G y and z = e„ — em, n,m & X , by 

(10) lJ.y{en - Cm) = ymLy{m, n). 

This gives the same limiting vector field {my)y^y as for the original process. 
(Note that Ly{m, n) is non zero for m ^ n only if n = m±fk for some k — 1, . . . , K.) 
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Theorem 3.1. (i) Let H be the functional defined by ([9]) for the above modified 
process. The Lyapunov function g given by ^ satisfies 

(11) H{y,Vg{y)) = Q (y G^), 
and 

Vgiy) =0^my = 0. 

(ii) Let yo be a stable equilibrium of the dynamical system y = yLy associated 
with the model of [5] or equivalently with its modified version. 

Denote V{yo,y) the quasipotential of the modified process, relative to j/o- 
The following equality holds on some neighborhood of j/o •' 

V{yo,y) ^ g{y) -giyo)- 

Remark 3.2. Before proving the theorem, let us make a remark on equation ([TT]) . 
Assume that g solves ([TT]) and satisfies 

(12) \7g{y) ^O^rUy^O, 

then g is a Lyapunov function for the dynamical system y — ruy. 

Indeed due to strict convexity of H{y,-), the solutions a of H{y,a) < are 
a strictly convex subset C of R''. Since the boundary dC contains 0, and rUy = 
y aH{y, 0) is the exterior normal at 0, then {my, a) < for any a in C, and equality 
holds only for a — 0. In particular, equation ()lip implies that {my,\I g{y)) < 0, 
and that (mj,, V.g(y)) — holds only if ^g{y) = 0, hence only if my = under 
assumption (fT2|) . 



Proof, (i) H writes: 

(m,n)6A'2 

o 

(Note that in order to fit conditions I to III of 7 on y, a should vary in RI'^'^^, 
Sn ~ Sm being replaced by its projection on R'"^'"^, and scalar products being 
understood in RI'*'~^. But for computing H{y, 'SIg{y)), it is easily checked that the 
result in unchanged if one keeps the original definition of 5 as a function oiy e R''^' 
and uses the scalar product in R'"^'). 

Denote Vp(y), as in Section[31 the reversible distribution associated with generator 
Ly, and set qy{m,n) = i'p(^y)(m)Ly{m,n) so that qy is symmetric in {m,n) £ X^. 
Then 

(m,n)eA'2 



{y,nLy{m,n) e-'^^'^^y'^'''"''^ -y,,Ly{n,m) e~'^"^<i^y'^^''-'^^{e'^^3{^ 



1 

2 ^ 

(m,n)6A'2 



> 5 (^,^)(^!:^e-<^^('')^^-> ^e-(Vg(y),e„>U 



The result follows from the fact that (Vg(y), e„) = log — ^^V^ + 1 — log Z(p(y)), as 
can easily be computed from equation dHl), so that — ^^y-r e"^^^^'')''^"^ is indepen- 



dent of n e A". 
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(ii) is then essentially a consequence of a result by Freidlin and Wentzell, stated 
in [7] as Theorem 4.3 of Chapter 5. Since a "local" variant of this result is actually 
needed, an independent proof is given, for completeness. Recall that 

^(yo, y) = inf {Soriifi) : T > 0, <^ absolutely continuous, ipo = yo,(pT = y} , 

and consider any T > and any absolutely continuous (p on [0,r] such that (po = 
yoi = y- Reversing time variable t in the integral S'ot('^) = Jq L{(pt, (ft) dt gives 
SoTi<p) = Jo L{'ipt, -ipt) dt where ipt = (pr^t for < t < 0. 

Introduce the following family of measures {fly)yey on — Z, defined by 

fLy(z) = e-<^9(^)'-Vy(-2) e -z). 

(Considering fiy as the jump length distribution for the local random walk approx- 
imating in the neighborhood of y, fiy corresponds to the reversed random walk 
with respect to the measure {e~^'^^'^'^^'^'^)zez, which is stationary by ([Tl]) and ([9|).) 

Define H and L associated with (fly) in the same way as H and L with (/ij,). 
The following relations are easily checked: for any y ^ y and a e R"^, 

H{y,a)^Hiy,Vgiy)~a) and /?) = L(y, -/3) + (V<7(2/), /?). 

One gets 

Sot{^)^ f Li^Pt,ijt)dt- [ {Vg{tPt),^t)dt= j Li^Pt,^t) dt + g{y) - giyo) 
Jo Jo Jo 

since tpo = y and ipT — yo- 

All that is left to prove now is that for y close enough to yo, 

(13) inf <! J L{'ipt, V't) dt : T > 0,^ abs. continuous, ■00 = J/j = J/oj' — 0- 

Using Remark |3.2[ it can be shown that g is a Lyapunov function for the "locally 
reversed" dynamical system 



y 



where rfiy = zfly{z). 



ze-z 



Indeed H{y, Vg{y)) = H{y, 0) = for all y and p2)) is satisfied with ifiy in place 
of niy since Vgijj) — both implies that ruy = by (i) and that = ~'>^y from 
the definition of fly. 

One can deduce from this that yo is also a stable equilibrium point for the 
dynamical system y = rhy. As a consequence, there exists a neighborhood M of yo 
such that all trajectories initiated in Af converge to yo at infinity. Assume from now 
on that y G Af and consider the trajectory ip initiated at y, then limt_>_|_oo V't = yo 
and /g °° L{il)t,^t) dt = 0. 

It is then easy to derive that the infimum in (fT3|) is non-positive, using bounded- 

o 

ness of L{y, /3) on compact subsets of y xR"^. The result follows since this infimum 
is clearly non- negative (as L > 0). 

□ 



Remark 3.3. We conclude this section with two heuristic remarks. 
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First, (fTTj) can be seen as the limiting balance equation satisfied by tt^ if the 
approximation 

(14) 7r^(y) « — as iV ^ oo 

Zn 

is valid with enough accuracy for some differentiable g. Indeed, the balance equations 



p-Ng(y) /,„,,, \ 

become — ^ //^(z) (^e<^f - 1 j = under since 

7r^(2/-^)/7r^(y)«e<^«(^^'^> and {y - ±,y) ^ {y,y + I-) ^ ^^^{z). 

This intuitively confirms the relation between solutions of (jlip and the quasipoten- 
tial stated in (ii) of Theorem [SU (or in Theorem 4.3 of Chapter 5 of [7]), since in the 
unique equilibrium case, the quasipotential is expected to be the action functional 
associated to the invariant distribution. 

Secondly, the above proof of (i) suggests that for the modified process, the mea- 
sure {e~^^^^^)y^yi^ solves the /ocaZ balance equations in the limit. Indeed, from (fTO|) 
and the proof of (i), g solves 

(15) iJiy{z)-iJLy{-z)e'^''3(y),^) {y^y,z&Z). 

This relation appears as the limiting identity obtained from 

via the same approximations as in the first part of the present remark. The modified 
process can thus be considered as asymptotically reversible. This is a particularity 
of the dynamical system in [2]. For the analogous modified version of the process 
in [5], no g satisfies equation 

4. Lyapunov function and relative entropy 

This section is devoted to a rereading of the Lyapunov function g, given by (O, 
for the model in [2] . It is connected to a well known decreasing property of relative 
entropy. Two other models can then be introduced, for which a similar relative 
entropy argument for constructing a Lyapunov function applies. Convergence of 
their stationary measure to a Dirac mass can then be derived. 



4.1. A reformulation of the Lyapunov function. Section [3] has provided an 
interpretation of g in terms of the quasipotential associated with another Markov 
random perturbation of the same dynamical system. The Lyapunov property of g 
is now given an interpretation in terms of relative entropy. 

Underlying both interpretations, it appears that the model in is very partic- 
ular, due to the quantities [/fc, y] that drive the M/A4/C/C generators Ly involved 
in equation ([3|). 
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For y,y' G y, two probability distributions on X, the relative entropy of y with 
respect to y' is defined as: 

KvW) = ^yniog^. 

o 

It is non- negative, and finite if y' G 3^= {y G for all n S A"}. 

Relative entropy appears in the following, easily checked, expression of g: 

K 

(16) g{y)^h{y\vpi^y))-\ogZ{p{y)) + Y.M[h,y]) {yey) 

A/c +"fk[lk,y] 



fc=i 



where i'p(y) is the Erlang reversible distribution of Ly (here (y) 
for 1 < fc < i<r) and: 

i'k{x)= r Y (fc=i,...,if). 

Jo Afc + 7fcU 

Note that, though no mention of relative entropy is made in [2], it is there noticed 
that critical points of g on 3^ correspond, through p i— >■ i^p, to critical points of some 
function of p (given by the two last terms in the right hand side of (|16p). This was 
the clue for a dimension reduction argument. 

The Lyapunov property of g will be explained from the classical decreasing prop- 
erty of the relative entropy between the distribution at time t of some Markov 
ergodic process and its invariant distribution. Entropy dissipation and its quan- 
tification are widely present in the literature. Classicaly, estimating the entropy 
dissipation is an alternative to logarithmic Sobolev inequalities for obtaining expo- 
nential rates of decay to equilibrium (see for example [4]). In a different context, [16] 
introduces a method for deriving hydrodynamical limits (see also 1121, |10|) by con- 
trolling the variations of the relative entropy between the current distribution and 
the so-called local equilibrium, varying in time. Our situation differs from the usual 
ones, in the sense that the generator itself varies in time: y solves y{t) — y{t)Ly(^iy 
However, this can be compensated by adding appropriate terms. This is made 
possible because pk{yYs depend on y only through quantities [Ik, y], that naturally 
appear in the expression of h{y\h'p(^y^). This method for building a Lyapunov func- 
tion is thus restricted to very special dynamics. A different example will be given 
in 14. 3[ for which the method applies due to invariance of [/, y] along the flow. 

In the following proof, the reversibility of generators Ly manifests itself, as it is 
classical, through the Dirichlet form. 



Proposition 4.1. Assume that for y & y , Ly is the infinitesimal generator of an 
M/M/C/C queue with K classes of customers having capacity requirements Ak 
and arrival-to-service rate ratios pk{y) = ^k{[Ik, y\) for fc = 1, . . . , K , where the ipk 
are positive functions on R. Set p{y) = {pk{y), 1 < ^ < K) for y € y. 

Then the following function is a Lyapunov function for dynamical system ([3]) .• 

K 

9{y) = KyWp(y)) - ^ogZ{p{y)) + ^i)k{[ik,y]), 

fc=l 

where, for A; = 1, . . . , K , Tp^ is some primitive of x x '^^\ \ . 

fk{x) 
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Proof. Using the definition of relative entropy togetlier witfi ^ gives for y G y, 
9iv) = y^^'^^s-f^+'^Mih^y]) = ynlog{n\yn)+Y (i^k{[h,y])-[Ik,y]^o 

Due to the relation, for k — 1, . . . ,K, between ipk and the ipk satisfying pk{y) — 
'fk{[Ik^y])^ derivation with respect to y„ {n G X) simply yields: 

It must be proved that yLy'Vg{y) < for all y £ y, equality holding only when 
yLy — 0. Now yLyVg{y) can be expressed using the following identity due to 
reversibility of generator Ly with respect to distribution i^p(y) ■ for u € IR'* , 



(18) yLyU^~- V qy{m,n)( — 



where qy{m,n) = h'p(^y-^{m)Ly{m, n) is non-negative and symmetric in (m,n). 

(yn 

and u.) Then using (fT7| . 

1 \ ^ / \ ( ym yn \ / 1 Vm n l/n 



yLyVg{y) ^ V qy{m,n)( — ^^)(log — ^^^-log 

^ i^ra^ex^ Vz/p(j^)(m) Up(^y){n)J\ Vp(y){m) Vp(y){n) 

This shows that yLy'S/g{y) < for all y. It can be zero only if ym/i^p{y){fn) — 
yn/vp{y){n) for all pair m,n such that qy{m,n) > 0. By irreducibility of Ly, this is 
possible only if y-n/ i^p(y){n) does not depend on n, which means that y — Vp(y)- 

□ 

4.2. Some Statistical Mechanics formalism. Measures Vp with p e]0, +oo[^, 
that include the fixed points of all our models, can be written in the following Gibbs 
form: 

^p('^) = 177-TCxp VCT^fclogpfc - logrifc!) = — ^exp((6',n) - logn!) (n G X). 

z{p) ^ z{e) 

where 9 = {9i, ... ,9k) is defined by 9k — logpfc {I < k < K) and appears as 
the natural Gibbs parameter. It is then convenient to re-parametrize the fam- 
ily (i^p) as (vg) for 9 G (abusively writing Z{9) for Z{p)). This labelling is 
clearly one-to-one. 

We now address the problem of minimizing the relative entropy distance of a 
given probability measure y on A" to the set of i/g's. It is related to some classical 
results in Statistical Mechanics. Yet, our arguments may not be standard. A 
more complete overview can be found in [5], where this problem underlies some 
contraction principles related to Large Deviations of i.i.d. random vectors. Only 
the case if = 1 is relevant for the present paper, since the two next models are one 
class, but Proposition 14.21 is worth mentioning in the multidimensional case for its 
own sake, or for possible extension of section 231 to several classes. 

First, it is classical that derivating the "free energy" logZ gives the "magneti- 
zation" , that is, the expectation of the Gibbs measure: 

VlogZi9)^[I,iyg]. 
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Note that for Z regarded as a function of p. it gives 

^l^ = l[4,.,] = i-B,(p) (fc = i,...,i^), 

OPh Pk 

using the well known relation [7^, Vp] = pk{l — Bk{p)). Here for k = 1, . . . , K , 

is the so-called "blocking probability" corresponding to class k for parameter p, 
that is, the probability that a new class k customer is rejected in an M/M/C/C 
queue with load p in its stationary regime. 

Next, log Z{9) is strictly convex with respect to 6: This can be shown using the 
relative entropy between two Gibbs measures ug. Indeed for 6, 9' e 

ue'{n) ^ Z{e) 



(19) KveW) = J2 Mn)log^^=log^ + 



nex 
which rewrites 

logZ{e') - logZ{e) = {W log Zig,0' -e) + h{iyeWe'). 

This shows that the non- negative quantity h{i'e\ve') (positive if 6' ^ 9) measures 
the difference between the graph of log Z and its tangent hyperplane at 9. It proves 
strict convexity of \ogZ{9). 

Properties of the relative entropy of some y G y with respect to some ve can 
then be derived. For y E y and 9 £ R^: 

(20) %|i/e)= V2/„log^=logZ(0)+Vy„log(n!y„)-([/,y],0), 
^x ''^W n 

so that for fixed y, the relative entropy h{y\i'0) is also strictly convex in 9 (as the 

sum of logZ(6') and an affinc function of 9). 

o 

It is not difficult to show that if y €y (that is y G y and j/n > for all n), 
then h{y\i'g) tends to infinity as 116*11 — >■ +00: Indeed, for any 9 € R^, the following 
inequalities hold: 

logZ{9) - {[I,y],9) > max((0,n) -logn!) - {[I,y],9) 

n^X 

> max(n,^) — {[I,y],9) — max(logn!). 

n^X nGX 

Now setting hy{9) = imi^nex{n,9) - {[I,y],9) = X)m yni(™ax„(n, 6*) - {m,9)), 
hy{9) is positive for any 6* 7^ since all 2/„ are positive and the terms (m, 0), m G X, 
cannot be all equal (recall that, since Aj. < C for k — 1, . . . , K , the set X contains 
together with the canonical vectors /i, . . . , /k)- Since hy is continuous on R^, it 
is bounded from below by some positive constant on the unit sphere of R^. Then 
using the fact that hy{9) = 116*11 /ij, (6*/ 1| 6*11) for all non-zero 9, it results that hy, and 
hence h(y\i'g), tends to infinity as \\9\\ —t- +00. 

As a consequence, h{y\i'g) attains one unique minimum on R^ at some value 
denoted 9{y). Derivating h{y\i'g) with respect to gives that 9{y) is the unique 
solution of 

[I,'ye] = [I,y]- 
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(Note that unicity also appears on the fohowing relation, itself derived from ([19]): 

h{iyeWe') + hiiyg>\iyg) = {[I , i^e'] - [I , i^el 0' - 0) , 

which proves that equality [/, vgi] — [/, vg] is possible only if i/gi — vg, i.e., 0' — 9.) 
One gets the following result: 

o _ 

Proposition 4.2. For any y i^y, there exists one unique 9 e R^, denoted 9{y) 
such that [I , Vgi^y)] — [I, y]- This 9(y) minimizes 9 i— )■ h{y\i'g), and moreover satisfies 

h{y\ve) = h{y\vg^y-^) + h{vg^y-^\vg) for any 61 e K,^ . 

Proof. Only the last relation is left to prove, but it is a direct consequence of (PH)) , 
and = [/,y]. □ 

Remark 4.1. From the additive formula in the previous proposition, it also results 
that for any fixed 9,9 € R^, the measure Vg minimizes y h{y\iy'g) on the set of 
probability measures y having mean [/, Vg]. Theorem VIII. 4.1 in [6 shows that this 
minimum value can be read as some Legendre-Fenchel transform. 

As a corollary, getting back to the p-parametrization, one gets that the mapping 

o 

p [I,i^p] is one to one from the set ]0,+cx)[^ onto the set {J2nex ''^V^^'V ^y}- 
When K ^ 1, the last set is simply the interval ]0, C[, but for larger K it is not easy 
to characterize. Like the convex hull of X: {X^nsAr "■2/"' 2/ ^ y}^ arithmetically 
depends on integers C and ^fe's in some intricate manner. In particular it does not 
coincide in general with the set {m ejO, +oo[^ : ^k^k < C}- 

Remark 4.2. The term {[I,y],9) in relation (pUj) explains the particularity of 
the case where pk{y)'s are functions of [Ik,y]'s, as considered in Proposition 14.11 
Another nice situation, which is the case for the next model, is when [/, y] remains 
constant along the trajectories of the dynamical system. 

4.3. A closed system. The next model again describes a system of N nodes with 
the same capacity C, but here no rejection can occur: Customers are directly routed 
towards non saturated nodes (one can imagine that they are randomly rerouted as 
many times as necessary, at a null time cost, so as to find some node having the 
required free capacity). 

In this model, there are no external arrivals nor departures. M customers are 
present for ever in the system, with M < NC. Each customer spends an exponential 
time with mean one at each visited node, after which he chooses uniformly one new 
node among those, different from the current node, that are not saturated (if the 
current position is the only non saturated one, the customer does not move). All 
exponential variables and choices of successive nodes are assumed independent. The 
model is analyzed through the following asymptotics: N and M = M{N) tend to 
infinity with M{N)/N converging to some A g]0, C[. 

For fixed N and M with M < NC, the empirical measure process is defined as 

in 111 and here denoted {Y^{t),t > 0). It is a Markov jump process on the finite 

subset y^j = {y = (?;„, < n < C) e y : Ny^ e IN for n ^ 0, . . . , C and [/, y] = 

En^inyn = M/N} oi y ^ {y ^ {yn,0 < n < C) e [0,+oo[^+^: En=o = 

The transitions are the following (e„ still denotes the n*'' unit vector in IR'^^^): 

1 , , Ny„i — 1 

(21) y — > y + —{e,n+i ~ e-m + Cn-i - e„) at rate Nnyn rr--; r , 

A^ A^(l-yc) 
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for < n < C and 0<m=/=n<C— I. (This corresponds to some move from some 
node in state n to some node in state m. Note that due to the condition M < NC, 
yc < ^ for y £ 3^M-) It is clear that is irreducible and thus admits one unique 
invariant distribution. 

Remark 4.3. Extension of this model to the case with K > 2 classes of customers 
(with capacity requirements Ai, . . . , Ax) is problematic, since in this case, the 
Markov process analogous to Y^} is possibly non irreducible. For example, consider 
the case of N nodes, each of capacity 6, and 2N customers, TV of each of two classes 
with Ai = 3 and A2 — 2. The distribution with one customer of each class at each 
node does not communicate with any other configuration (e.g., for N even, with 
the configuration with N/2 nodes occupied by two class 1 customers and the N/2 
others by two class 2 customers), because only one unit of free capacity is available 
at each node. And yet, the total free capacity goes to infinity proportionally to N. 

This problem could be solved in some sense by replacing this closed system by 
the open (irreducible) one next introduced in 14.41 extended to the multiclass case 
(see Remark l4. 51 below), that should have the same limiting dynamics in restriction 

to yx. 

Analogously to the previous examples, it can be shown that as N, M go to 
infinity with M/N converging to A, the process (Y^(t),0 < t < T) converges in 
distribution, for any finite T, to the solution with initial value ?/(0) of the following 
differential system of equations: 

(22) y'^{t) = y„-i(<)l„>i + [n+ l)j/„+i(t)l„<c-i 

1 - 

-i , ^ %i<c-i+n)yn{t) (n = 0,...,C). 

provided that ^^^(0) converges in distribution to j/(0). 

Since M/N converges to A, the initial point y{0) necessarily belongs to the set 
y\ = {y y '■ X^n "2/" ~ the next proposition will show, unsurprisingly, 

the set y\ is invariant under the above system. Now since A < C, t/c < 1 for any 
y ^ y\, so that for y(0) £ y\, the solution of ((22)) is defined on the whole time 
axis. 

This system rewrites as ^ where now, for y £ y\, Ly is the rate matrix of an 
M/M/C/C queue with arrival rate p{y) = and service rate 1. 

Equilibrium points are again characterized by ([S]), where p{y) = — and fp is 
defined by @ for p > 0. This fixed point equation has one unique solution. Indeed, 
since < A < C, ProDOsition l4 . 2 1 above shows that there is a unique p s]0, +oo[ such 
that [/, i/p] = A. Denote it px- Equation ([S]) rewrites: y = Vp with p — and 
B{p) = Vp{C), or equivalently, using the relation [/, Vp] = p{l — B(p)): [I, Vp] = A, 
so that Vp^ is the unique equilibrium point for ([3|) on 3^a- 

Proposition 4.3. Fix A g]0,C[ and assume that for y e y\, Ly is the rate matrix 
of an M/M/C/C queue with arrival rate p{y) = — and service rate 1. Then 
(i) The set y\ is invariant under the dynamical system 

(a) g{y) = h{y\vp^) is a Lyapunov function for this dynamical system on yx. 
(Hi) The sequence of invariant probability distributions of processes Y^^j^^^ 
converges weakly to the Dirac mass at Vp^ as N,M{N) — > 00 with M{N)/N — )■ A. 
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Proof, (i) Set /(y) = ^„ n2/„ (y G J^). Then V/(y) - (n,0 < n < C). The 
derivative of / along the dynamical system (|22l) is given by yLy\/f{y). Using (fT8|) 
with the present reversible generators Ly and m„ = n for < n < C gives 

yL,V/(y) = - X! " + 1) ( n - ^Vt) ' 

where n + 1) = i/p(j,)(n)Lj,(n, n + 1) = (n + + 1, n) so that 

c-i 

(23) yLyS/f{y) = - ^ (^y„+iij^(n + 1, n) - y„Ly{n, n + 1)^ 

n=0 
C-1 

= - X! + - p(y)yn) = (i - yc)p{y) - ^nyr,^Q 

n— n 

for y G 3^A, which proves invariance of y\ under (f^ . 

(ii) Using relation (PH)) together with invariance of [/, y] under the present dy- 
namical system gives for y G y\ 

yLyVgiy) = yL, ( log(n!y„) + l)^^^^^ = yi,(log ^^)^^^^^, 

(as shown by (|18p . yLyU is inchanged through adding some constant to u). Then, 
again using invariance of [/, y] under the dynamics, which writes yLy(n,Q <n< 
C) = 0, one also has 

vLyVgiy) = yLy ( log ^^^^^l^ipiy))) .^.<_c ^ ( ^) o^.<_c 
The argument is then the same as in the proof of Proposition 14.11 

(iii) We only give a sketch of the proof, which is the same as in [2]- It is first 
proved that the infinitesimal generator Vl^ of the Markov jump process given by (|2ip 
converges, as N, M —^oo with M = M{N) and M/N — ^ A, to the degenerate 
generator given by: VLf{y) — yLyV f{y). This convergence holds for functions / 
on y, and is uniform in /. It is then standard that any weak limit tt of the invariant 
distributions (tt^) of generators ft^ , solves nft — 0. 

The Lyapunov function g helps then proving that the Dirac mass at the unique 
equilibrium point of the dynamical system (j22p is the only invariant probabil- 
ity measure for generator Q. Indeed, nfl — implies in particular that irilg = 
Jy yLyVg{y) TT{dy) — 0. The integrand being non-positive, and zero only at Vp^, tt 
needs be supported by this single state. 

One concludes that the Dirac mass at Vp^ is the only weak limit of the sequence 
(tt^), so by compactness of V{y), it is the limit of (tt^). 

□ 

Remark 4.4. Note that the above g could be replaced by h{y) = h{y\iyp) for any 
fixed p since, by Proposition 14. 2[ g and h only differ by the constant h{vp^ Wp)- 

4.4. An open version. The next model is analogous to the previous one, in the 
sense that customers are instantly directed to available nodes. But now, new cus- 
tomers enter the network, are served at some node and then leave the network. Only 
one class of customers, requiring one unit of capacity, is considered (see Remark l4.5l 
below for possible extension to several classes). Customers enter the system, still 
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consisting of N nodes, according to some Poisson process with intensity XN. Each 
customer is instantaneously directed, if possible, toward some node chosen uni- 
formly among those having one free unit of capacity, that he then occupies during 
an exponentially distributed time with mean 1. If no such node exists, the customer 
is definitively rejected. 

We denote by Y^{t) {t > 0) the empirical distribution of the nodes at time t, 
defined as in ([T|). Its state space is the finite subset = {y = (j/n,0 < n < 
C) e y : Ny„ e M ior n = 0, . . . ,C} of y = {y = (y„, < n < C) G [0, +oof+^: 
Y^nVn = !}• 

Notice that the total number of customers present in the system: N nY^ — 
N[I, Y^] is simply an M/M/CN/CN queue with arrival rate XN and service rate 
1. Considering [I,Y^] as N grows to infinity is equivalent to Kelly scaling for 
the M/M/C/C queue. When A > C the situation is simple: In the limit, the 
renormalized queue gets close to some deterministic trajectory that is constant 
equal to C after some time. This means that after some time, for large N, the 
system is saturated. 

It will be assumed that < A < C, so as to maintain the system in a no-rejection 
regime. Indeed this case corresponds to the subcritical regime of Kelly's asymp- 
totic: [/, Y^] converges to some process with values in ]0, C[ for t > (having limit 
A at infinity) so that in the limit, no rejection occurs. 

{Y^{t),t > 0) is a family of irreducible Markov processes on y with the following 
transitions, respectively corresponding to some arrival or departure at some node 
in state n ^ X: 

r y + ^(e„+i-e„) A7V^l,^<i (0 < n < C - 1) 

y — > < at rate 

\ V+ ^(cn-i - e„) Nnyn (0 < n < C) 

Since each Y^ actually evolves in a finite subset of y, these processes are ergodic; 
their invariant distributions will be denoted tt^. 

Apart from the particular case C = 1, in which coordinate Y-^ of Y^ (that is 
the proportion of occupied nodes) is itself a renormalized M/AI/N/N queue, Y^ 
is non-reversible and its invariant distribution is not explicitly known. 

The process Y^ (t) converges in distribution, on any finite time interval [0,T], 
to the solution of the same differential system (1^^ as in the closed case, here 
considered on the enlarged space y \ {Sc}, instead of y\. This holds provided 
that Y^{0) converges in distribution to some y{0) such that yc{(^) < 1- The 
assumption that A < C is crucial here, ensuring that the condition yc < I is pre- 
served in time: Indeed the last equation in the above differential system writes 
Vci^) — A 1^;^^ (f ) ^Cyc{t) < \ — Cyc{t) < for ycit) close to 1, so that yc cannot 
reach the value 1, guaranteeing existence and unicity of a solution to (122]) defined 
for all positive times. 

This system can again be read as ^ where Ly is the infinitesimal generator of 
an M/M/C/C queue with arrival rate and service rate 1. Equilibrium points 

are thus characterized by ([5]), where p{y) = j^^, or by ?; = Vp with p — j^r^^^- 
Then as in the previous model, using the relation [/, I'p] = p(l — B[p)) together 
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with Proposition 14.21 Vp^ is the unique equihbrium point for ([3]) on 3^a, where p\ 
is characterized by [/, Vp^] — A. 

Proposition 4.4. As N goes to infinity, the invariant distribution tt^ of process 
converges to the Dirac mass at Vp^ . 

Proof. The Lyapunov function g{y) — h{y\vp^) for the previous cfosed system is no 
fonger a Lyapunov function for the present model, though the differential system 
is formally the same. Indeed the state space is here larger, consisting of 3^ \ {5c} 
instead of y\, and the Lyapunov property of g relied on invariance of [I,y] along 
the dynamical system ([^ restricted to yy. This is no longer vahd on 3^ \ {^c}- 

Nevertheless one can restrict to the set y\ once the following is noticed: The 
quantity l{y) ~ ([/, y] — A)^ decreases along the flow. This results from relation (|23|) 
in the proof of Proposition |4?3l that remains valid except for the last equality. Here 

yLyVfiy) = A - [/, y] where /(y) = [/, y] , 

so that yLyVl{y) = -2(A - [/, y\f < 0. 

Arguing as in the proof of (iii) of Proposition 14.31 gives that any weak limit of 
the sequence (tt^) is supported by the set {y & y ■ l{y) = 0}, that is yx. Then 
using the Lyapunov function g{y) = /i(y|z/p^) for the system restricted to y\ shows 
as previously that the Dirac mass at i/p^ is the only weak limit for the sequence 
(tt^), which proves convergence by compactness of Viy)- 

□ 

Remark 4.5. Extension to several classes of customers here preserves irreducibility 
but raises the question: Under what condition, analogous to A < C, should the 
previous results generalize? 

Consider K classes of customers with arrival rates A^A^, service rates /ifc and 
capacity requirements Ak {Ak > 1) for k = 1,. . . ,K (customers of class k being 
here again, if possible, directed toward some node chosen uniformly among those 
having Ak free units of capacity, and being rejected otherwise). 

Now the total number of customers is no longer anM/M/ CN / CN queue: Indeed 
when some Ak is larger than 1, some class k customer can be rejected though there 
are Ak free units of capacity in the system, because no such volume of capacity 
is available at a single node. The condition X^fc^fc^ < ^ (ensuring that the 
M/M/CN/CN queue with parameters A^'s, /Zfc's, AkS and C is subcritical) is thus 
irrelevant. (As an example, consider two classes of customers respectively requiring 
= 3 and A2 = 2 units of capacity, while C = 3. The process is exactly the same 
as if parameters were Ai = A2 = C = 1, since each node can be occupied by at 
most one customer). 

o 

The right condition should be {\k/^^k)k € {[^, GJ^}, which is equivalent to 
existence of a p such that [I,Vp\ = {\k/p^k)k, by Proposition 14.21 This condition 
says that \N\k/ ^ik~\ customers of each class k can be simultaneously accomodated 
for A^ sufficiently large. But contrary to the one class case, this condition does not 
ensure that the system stays in a non blocking regime in the limit. For example 
in the very particular case when Ai = ■ ■ ■ = Ak = C — 1, the empirical process 
(simply consisting of the densities of customers of the different classes) is itself a 
renormalized M/M/N/N queue. The previous condition writes "^k^k/fJ-k < 1, 
which is the subcritical regime of Kelly. The limiting dynamics is known (see for 



METASTABILITY IN COMMUNICATION NETWORKS 



25 



example [8]) and for some values of the parameters, the trajectories can spend some 
non negligible time on the blocking region yo = 0. 
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